COMPLEXITY OF NILPOTENT ORBITS AND THE 
KOSTANT-SEKIGUCHI CORRESPONDENCE 



DONALD R. KING 

Abstract. Let G be a connected linear semisimple Lie group with Lie algebra 
g, and let K c — > Aut(p c ) be the complexified isotropy representation at the 
identity coset of the corresponding symmetric space. Suppose that Q is a 
nilpotent G-orbit in g and O is the nilpotent K c -orbit in p c associated to 
f2 by the Kostant-Sckiguchi correspondence. We show that the complexity 
of O as a K c variety measures the failure of the Poisson algebra of smooth 
i^-invariant functions on Q to be commutative. 



1. Introduction 

The Kostant-Sekiguchi correspondence is a vital tool in the study of infinite 
dimensional representations of semisimple Lie groups. Let us recall some facts 
about this correspondence in case G is a connected real, linear semisimple Lie 
group with maximal compact subgroup K. We obtain the corresponding Cartan 
decomposition g = { © p where g (resp. t) is the Lie algebra of G (resp., K). The 
vector spaces g, B and p are then complexified to give a vector space decomposition 
of g c , the Lie algebra of G c (the complexification of G), as g c = t c ffip c . The 
Kostant-Sekiguchi correspondence is a bijection between the nilpotent G orbits in g 
and the nilpotent K c orbits in p c . (For the precise definition of the correspondence 
we refer the reader to |2j.) 

If SI is a nilpotent G-orbit in g and O is the nilpotent if c -orbit in p c associ- 
ated to SI by the Kostant-Sekiguchi correspondence, then (SI, O) is said to be a 
Kostant-Sekiguchi pair. Among the nice elementary properties of such a pair are: 
(1) SI and O lie in the same G c orbit which we denote by Oc and (2) O is a La- 
grangian submanifold of Oc (relative to the Kostant-Souriau symplectic form on 
Oc-) Moreover, Vergne has established a much deeper relationship between S7 
and O, namely that there is a if-equivariant diffeomorphism which maps SI onto 
O. 

Recently, the author proved that if (SI, O) form a Kostant-Sekiguchi pair then 
SI is multiplicity free as a Hamiltonian iif-space if and only if O is a spherical 
K c variety 2 . (The definition of multiplicity free is given below in Remark 12.11 
Spherical K c -varieties are defined below in Remark 12.31 1 The goal of this paper 
is to prove a generalization of that result to all Kostant-Sekiguchi pairs. That 
generalization is contained in Theorem 13. II In essence our theorem shows that the 
complexity of the K c action on O measures the failure of the Poisson algebra of 
smooth if -invariant functions on SI to be commutative. 

The author wishes to thank A. T. Huckleberry for his proof of the density result 
in Proposition 12 . II and Maxim Braverman for some useful discussions. 
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2. Notation and key definitions 

We now introduce some further concepts and notations. Unless otherwise in- 
dicated, in this section K will denote an arbitrary compact group. We assume 
that K is contained in its complcxification K c . Our basic reference for symplectic 
manifolds with Hamiltonian if -actions is [jj]. 

If A C G c is a Lie subgroup and S C g c then A s denotes the subgroup of A 
that fixes each element of S under the adjoint action of G c on g c . If a C g c is a 
Lie subalgebra, then a s is defined similarly. 

For the remainder of this section X will denote a connected symplectic manifold 
which is a Hamiltonian if-space. Let the if -invariant symplectic form be u>x and 
the moment map be <& : X — > 6*. 

Definition 2.1. Let 21 = C°°(X) be the algebra (with respect to Poisson bracket) 
of K invariant smooth junctions on X. 3 denotes the center of%. 

Remark 2.1. X is said to be multiplicity free if 21 = 3 i.e., 21 is a commutative 
Poisson algebra. 

In addition, we need to recall some facts about the symplectic structure of £1 
and the action of K on f2. (K is a maximal compact subgroup of G.) Suppose that 
ft = G ■ E. For each E' £ H, we identify Te'(^V), the tangent space of Jl at E', with 
the quotient g/g E . The Kostant-Souriau form wq on Jl is defined by setting 

w q \e>(Y, Z) = k(E', [Y, Z]) 

, for all Y, Z £ g where k denotes the Killing form of g. (Y and Z are the cosets 
of Y and Z in g/g E .) Wq is a symplectic form on f2. 

The action of K on Q, is the left action. If £ G t, then £ determines a global 
vector field £o on f2 according to the following definition: 



dt 

t=o 

where / is any smooth function on fl and E' £ CI. If Y is any smooth vector field 
on fl, Y(E') is the vector in Tg/(f2) obtained by evaluating Y at E'. 

Since wq is invariant under G, it is invariant under K. The K action on fl is 
Hamiltonian in the following sense. For each £ £ 6, there is a function <ffi £ C°°(f2) 
such that t(£n)u>s2 = —d<fi£, where t(£n) denotes interior multiplication by £n- We 
may take 0^ = k(£, •). We obtain the moment mapping $q : £1 — > t* by setting 
*n(-E')(0 = ^(-E'j = = K (K: for all E' £ and £ £ 6. ^ denotes 

the component of E' in J. 

Thus, f2 is a Hamiltonian A"-space, with moment mapping <1>q : O — >• t defined 
by sending an element E' £ £1 to its component in 6. (We have identified { with 
its real dual space 6* using the restriction of n to t.) Each function / in C°°(f2) 
gives rise to a smooth vector field Xf satisfying df(Y) = Wq(Y, Xf) for all smooth 
vector fields Y on fi. X/ is said to be the Hamiltonian vector field associated to /. 
(If £ £ t, then X^e. — £q.) C°°(fi) is a Poisson algebra under the Poisson bracket 
{■, ■} defined as follows: for /, g £ C°°(Sl), {/, g} = wn(Xf, X g ). One checks 
that the linear mapping £ i— > ^ is a Lie algebra homomorphism J — > C°° (O) when 
{•, ■} is taken as the Lie bracket on C°°(f2). 
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Lemma 2.1. Let E' £ X. Set W = W E > = T E <(K ■ E') and W 1 - equal to the 
orthogonal complement (with respect to Q = ws\e' ) of W inside Tb'(X), then we 
have the following orthogonal decomposition o/Tg'(X) into (real) symplectic vector 
spaces: 

T »w = ® « w n w±) {w n w± ^ ® ffWi' 

The restriction of ( to (W Ci W x ) © (W n W L )* is given by (((Y u Ai), (Y 2 , A 2 )) = 
Ai(y 2 )-A 2 (li) for allYt £ (WnW^), A 4 6 (WnW^)*. Moreover, (1) l*( E ')/l E ' 

and W H W 1 - are isomorphic (as t E modules) and (2) £/t®( E ) and — — — — -j- are 

isomorphic (as t E modules). 

Proof. See Corollary 9.10 and Lemma 9.11 of 3 . These results are steps in the 
proof of the normal slice theorem of Guillemin, Sternberg and Marie. □ 

Definition 2.2. If E" £ X (or t), set d{E") = dim if ■ E". Let d = d x be 

the maximum dimension of a K-orbit in X and let m = mx denote the minimal 
codimension of a K-orbit in X. d$ will denote the maximum dimension of a K 
orbit in ^(X). We define three important subsets o/X. 

(1) 

X d = {E' e X|dimJf ■ E' = d} 

Xo = {E £ X|3 an open set U C X such that E £ U and d(-) is constant on U} 

X* = {E' £ XldimX • $(E') = d$} = {E' £ Xldimt*^'' is minimum} 

Remark 2.2. From Proposition 27.1 in we know that Xo is open and dense in 
X. In addition, Xo C X f j. Otherwise there is a point in Xo whose K orbit has 
dimension d' < d. But, then there must be an open subset of points whose K orbits 
have dimension d! which is impossible. 

Proposition 2.1. X$ is open and dense in X. 

Proof. The fact that X$ is open is Lemma 1 in section 3 of UJ. The following proof 
(unpublished) that X$ is dense in X is due to A. T. Huckleberry. 

It suffices to show that XJ, the complement of X$, has codimension at least 2 in 
X. We use induction on the dimension of K. If dim if = 0, then K is finite. Then 
X$ = X since all K orbits in ^(X) are zero dimensional. Suppose dim if > 0. If 
x £ X|, , we need to show that there is an open neighborhood of x whose intersection 
with X|, has codimension at least 2. Let Kq denote the identity component of K. 
First consider X^ , the set of fixed points of iio on X, and its intersection with 
XJ. If Kq ■ x — x, we use the slice theorem to construct an open neighborhood 
U = K x E of x. Define E$ relative to the action of (K x )q in the obvious way. 
The argument for Proposition 27.3 in |S] shows that either (a) K (which equals 
(K x )q) acts trivially on E, or (b) U K ° has codimension > 2 in U. In case (a) K acts 
as a finite group on U so that U — J7$. In case (b) U K ° D (k$) c has codimension 
> 2 in U. This argument takes care of the points in XJ n ~K K ° . If x $ X^, then 
the slice neighborhood U = K Xp E has the property that dim K x < dim if. By 
induction (E$) c has codimension at least 2 in E. Thus (U<s>) c = K Xp (£<j.) c has 
codimension at least 2 in U. □ 



Since X^ and X$ are each open and dense in X, we have the following result. 
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Corollary 2.1. X$ n X^ is open and dense in X. 

We know recall the notion of a coisotropic submanifold of X. 

Definition 2.3. The orbit K ■ E' in X is said to be coisotropic if W^, C We 1 ■ 

By results of Guillemin and Sternberg |7j, X is multiplicity free as a Hamiltonian 
if-space if and only if there is an open dense subset U of X such that for E 1 G U 
the orbit K ■ E' is coisotropic in X. Therefore, it is reasonable to use the size of the 
Te 1 (K ' E r *) x 

quotient for generic K orbits to measure the failure of 

Te> (K ■ E') (~l Te> (K ■ E') 
X to be multiplicity free. 

Proposition 2.2. There is an open dense subset U o/X such that for all E' G U, 

the non-negative integer 

(2) dim W ■*£ r , 

T E >{K ■ E')nT E >(K ■ E') 1 - 

has a constant value. We denote this value by 2e(X). 

Proof. Choose U = X d n X$. Then for all E' 6 U, the decomposition of T B /(X) 
in Lemma 12 . 1 1 implies that 

(3) dim T E ,{K-E) = ^ x _ ^ + 

Te' {K ■ E 1 ) n Te> (K ■ E') 
Note that if there is another dense open set U' on which the dimension function 
in J2J is constant, then U' must have non-empty intersection with X^ n X$. Thus, 
e(X) is well defined. □ 

As a corollary of the preceding proof we have 

Corollary 2.2. Suppose that E' € X^ n X$, then 

dim W-E'f 

T E '{K'E')nT E '(K-E') x 
We recall from [H] or the definition of the rank of the action of K on X. 

Definition 2.4. The rank of the K-action on X, denoted by rxiX), is equal to 
rank K - rank K E , where E' G X and the orbit K ■ E' has maximum dimension 
among the K orbits in X. 

Finally, we recall from 0], the notions of rank and complexity of algebraic K c 
actions. 

Definition 2.5. Suppose that Y is a variety with K c action and is a Borel sub- 
group of K c . The complex codimension of a generic Bk orbit is called the complexity 
ofY , denoted ck c (Y) or c(Y) (when the reductive group K c is understood). IfUk 
is the nilpotent radical of B^ and B^ ■ z is a generic Bk orbit, then the codimension 
of Uk ■ z in Bk ■ z is called the rank of Y . It is denoted Vk (Y). 

Remark 2.3. c{Y) is also the transcendence degree (over C) of the Bk invariant 
functions in the field of rational functions (with complex coefficients) on Y. Y is 
spherical for K c if and only if c(Y) — 0. The rank of Y is also the transcendence 
degree of the Uk invariants in the field of rational functions on Y. 
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3. Main Theorem 

Our main result is: 

Theorem 3.1. Let (0, f2) be a Kostant-Sekiguchi pair, then 

(a) r K JO)=r K (n); 

(b) c(0)=e(Cl). 

This result was inspired by the main result of pp. 

We assume from now on that (fi, O) is a Kostant-Sekiguchi pair. The proof of 
Theorem 13 . II rca uires two important facts about O and O. The first is the existence 
of a K invariant diffeomorphism 

(4) Vn : O -»• O 

that was mentioned above. The second fact is the existence of a if -invariant dif- 
feomorphism 

(5) Mo : O -> K x kS V (s) 

established in the proof of Proposition 5.2 of 2 . To describe the vector bundle 
K x K s Vo(s) in we recall the notation of 0- 

There is a Kostant-Sekiguchi sZ(2)-triple {x, e, /} such that O = K c ■ e. The 
Kostant-Sekiguchi property means that (1) x E it, e, f E p c , (2) e = a(f), where 
a is conjugation on q c relative to the real form g, and (3) the following Lie bracket 
relations hold: [x, e] = 2e, [x, /] = —2/, and [e, /] = x. It follows that the Lie 
algebra Cx © Ce © C/ is the complexification of a Lie subalgebra s of g, where s is 
isomorphic to sl(2, R). Vo(s) is the quotient [t c , e]/[C, e]. In 2^ it is shown that 
K X K s Vo (s) is diffeomorphic to the conormal bundle of K ■ e inside the cotangent 
bundle of O. In addition, there is an isomorphism of K 5 modules over R: 

(6) vb(*)=i«7f ez. 

where Z is the sum (over C) of the positive eigenspaces of ad{x) on fi c that do not 
lie in t e . 

We now establish the main result, Theorem l3.ll 

Proof. We first establish part (a). 

By composing the i'C-invariant diffeomorphisms in (JIJ and JSJ, we have the as- 
signment: E 1 i— > o V(-E'). So we can identify £" with an equivalence class 
[k , y + z] in if x A , s Vq(s) where y 6 P/t B and z E Z. (See equation ©.) It 
is more convenient to consider the equivalence class M. o Vik^ 1 ■ E') = [1, y + z] 
where 1 denotes the identity in K. Assume that dim K ■ E' = d. Since dim if • E' 
is maximum, (1) {t 5 ) v+z has minimum dimension among the subalgebras (t 5 )" for 
v E Vq(s) and (2) (t s ) v has minimum dimension among the subalgebras (t s ) v for 
y' E F/r. (See Lemma 6.2 of EJ.) 

Set s R = (t s ) y and s c = (t s c ) v ■ Set S equal to the connected subgroup of 
K* with Lie algebra Sc and equal to the connected subgroup of S with Lie 
algebra Sr. Then S (rcsp., SrJ is a stabilizer of general position for the action 
of K* c on ^/t c 5 (resp., P/P). Also, fit 1 ' v +z \ the centralizer of [1, y + z] in t 
is equal to sr z . Since M o V is if -equi variant, J fe ° B = fl 1 ' Hence, since 

f- 6 = A<i(/co)(t feo B ), t E and sr z are isomorphic Lie algebras. Therefore, 

(7) r K {Q) := rank - rank t E ' = rank K - rank S R 2 . 
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From Panyushev (Theorem 2.3 in 5 j) r Kc (0) = r K °> {K*/K* c ) + r s (Z). By 
Corollary 2(i) of Theorem 1 in 4 , (K*/K^) = rank K x — rank Sr. By the 
observation following equation (6.7) in 0, rs(Z) = rank Sr — rank Sr z . Hence, 
by equation©, 

(8) r Kc (0) = rank K -rank S R 2 , 

which is the same as rjf(ft). 

The argument for part (b) of the theorem starts by noting that for all E' G ft, 
Lemma |2~T1 implies that if W = T E ,{K ■ E'), then 

(9) dimft = dimT B /(ft) = 2 dim (V^'V 1 ^') + dim + dim ' 
Therefore, 



wnw- 1 -' 

w 1 - 



(10) dimft = 2(dim!* (£; ' ) -dim« E ') + dim! - dim«* (B,) + dim- T 

Choose E 1 G H ft$. By Lemma 2 in section 3 of 0, we have 

e*(^)] C t £ '. Since C t*( B '>] - t E ')'- 

Since ) and t E have the same maximum semisimple ideal, 

(11) dimJ*^ - dimt E ' = rank 6*^') - rank t E ' . 
Applying Corollary 12. 21 equation (|10f> becomes 

(12) dim ft = dimt*^) - dimt B ' + dim£ - dimt E ' + 2e(ft). 
Since E' G ft^ n ft$, equation implies 

dimft = rank t*^'' - rank t E ' + dim! - dimt B ' + 2e(ft), 

where dim 6 — dim6 B is the maximal dimension of a orbit in ft. 

We have just shown that the codimension of the largest K orbit in ft is given by 
the expression 

, rank f {E ' ] - rank t E ' + 2e(ft) 

13 V ; 

= r K jO) +2e(Q). 

The last assertion follows from part (a). On the other hand, by equation (6.8) in 0, 
taking into account equation JSJ and the fact that c{0) — ck* (K*/K%,) + cs(Z) 
(Theorem 2.3 in [S]), the codimension of the largest K orbit in ft is also given by 
the expression: 

(14) r Kc (0)+2c(0). 

Part (b) of the theorem follows from equating l|13|) and 11411 . 

□ 
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